Papers by Carolin M. Schuster
Semantic Component Analysis: Introducing Multi-Topic Distributions to Clustering-Based Topic Modeling (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for topic modeling fail to scale to large datasets or assume one topic per document. |
| Approach: | They propose a topic modeling technique that discovers multiple topics per sample . they evaluate SCA on Twitter datasets in English, Hausa and Chinese . |
| Outcome: | The proposed technique outperforms the LLM-based TopicGPT on Twitter datasets with similar compute budgets. |
From BERT‘s Point of View: Revealing the Prevailing Contextual Differences (2022.findings-acl)
Copied to clipboard
| Challenge: | BERTology is a new approach to understanding the inner workings of large pretraining language models. |
| Approach: | They propose to invert the probing design to analyze the prevailing differences and clusters in BERT’s high dimensional space by extracting coarse features from masked token representations and predicting them by probing models with access to only partial information. |
| Outcome: | The proposed method extracts coarse features from masked token representations and predicts them by probing models with access to only partial information. |